Complex Construction Kits for Coupled Real and Virtual Engineering Workspaces

A concept of complex objects, being artifacts that have one real physical part and several virtual parts representing certain aspects of the object, is introduced. These parts are coupled by bi-directional double links of control and view, enabling a synchronous update of all part, if one of them is changed by user action or internal events. With a construction kit, being a set of compatible complex objects for a certain engineering or office application field, it is possible to build a system in reality with real parts, generating synchronously the assembly of virtual parts by means of a universal graspable user interface. The bi-directional double links allow the control of virtual parts by grasping and pointing on real parts and view the virtual parts by light projection into the real scene and vice versa, that is, control and view real parts by grasping and pointing on virtual parts. The concept is being demonstrated with prototypes for the application areas of pneumatic circuit design and flexible assembly systems.